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It has been a long time issue in statistical physics how to combine reversible microscopic equations 
with irreversible macroscopic behavior. Recently, Evans and Searles have suggested causality as 
the key concept for a solution to the irreversibility problem [D. J. Evans and D. J. Searles, Adv. 
Phys. 51, 1529 (2002) and Phys. Rev. E 53, 5808 (1996)]. This proposal is examined from a 
philosophical, i.e. conceptual, perspective, which reveals that the point of view taken by Evans and 
Searles is identical with the one already suggested by Boltzmann. According to Boltzmann initial 
conditions are responsible for the observed irreversibility of the macroscopic world. It is shown that 
reversibility requires a concept of causality, where causes and effects are interchangeable - at least 
on probabilistic grounds. Causality as interpreted by Evans and Searles is not compatible with 
microscopic reversibility and should itself be derived in order to solve the irreversibility problem. 

I. INTRODUCTION 

Recent times have shown considerable advance in the field of noncquiUbrium thermodynamics, also called ther- 
modynamics of irreversible processes. This important progress is closely connected with two related theorems: the 
Fluctuation Theorem Q, |^ and the Jarzynski Relation ^ |M IS- In 1999 Crooks showed that the latter is in 
fact a special case of the former f7|. By making exact statements about irreversible processes these relations touch 
fundamental issues in physics in general - for example they address the still partly unresolved question about the 
origin of irreversibility in the macroscopic world. In the next section, I will outline this problem, which from now 
on I shortly call irreversibility problem. The impact on several philosophical questions in physics, i.e. those dealing 
with the conceptual basics, was clearly realized by Evans and Searles ^ JJ. In their work related to the Fluctuation 
Theorem, they suggest the concept of causality as a solution to the irreversibility problem. In the following text, I 
will analyze the use of causality in 0, Q from a philosophical perspective. Subsequently, I will briefly sketch my own 
point of view concerning the connection between causality and irreversibility. 

II. DERIVING IRREVERSIBLE THERMODYNAMICS FROM REVERSIBLE MICROSCOPIC 

EQUATIONS 

A. An outline of the irreversibility problem and the standard solution by Boltzmann 

It is only in respondence to the criticism brought forward by Poincare, Loschmidt, Zermelo and others, that Boltz- 
mann arrived at a clear standing concerning a microscopic derivation of the Second Law of Thermodynamics. Poincare 
famously stated, that he cannot believe in a derivation when the results contradict the assumptions. Loschmidt for- 
mulated the reversibility objection, which reads as follows (not in the most general, but perhaps in the clearest form): 
When at a certain point in time, we reverse the velocities of all particles, then the system will develop as though 
backwards in time. This means in particular, that if entropy is increasing before the reversal then after the reversal 
entropy will decrease and vice versa. Since the reversible microscopic equations allow both processes, it seems that 
nature has no preference for entropy-increasing or entropy-decreasing processes. Boltzmann's solution to this problem 
is that entropy-increasing processes are much more probable than entropy-decreasing processes - thus identifying 
the increase of entropy with the development of a system towards more probable states. These statements about the 
probability of physical processes cannot come from the microscopic equations, since those are deterministic and they 
do not make any statements about probabilities. 

Thus, according to Boltzmann probability is the key concept responsible for introducing irreversibility into physics. 
This essentially refers to the probability of initial conditions. Obviously, this classic solution is closely related to 
the interpretation of entropy as probability, and thus has to be considered still valid today. However, the problem 
of irreversibility is not fully resolved at this point. Many questions remain. The most obvious was posed (and 
immediately dismissed) by Boltzmann himself: 'Why do we live in such an improbable world?' In a reply to Zermelo, 
he writes that we cannot expect to find an answer to this question just as we cannot answer, why there are phenomena 
and laws of nature at all Q ■ 

Many philosophers of science and physicists are not fully satisfied with this remark. Also, there are other important 
questions remaining. Some of them have come up only in the time after Boltzmann - e.g. if the cosmological arrow 
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of time, which is determined by the expansion of the universe, plays a role for irreversibility. Also, it has often been 
questioned, whether microscopic physics is really fully reversible. A famous example in this respect is the debate 
between Einstein and Ritz concerning the reversibility of electrodynamics, particularly of radiation phenomena j^. 
Another discussion concerns the irreversibility of quantum mechanics. To some the measurement-process seems to 
be a good candidate for implementing irreversibility into the fundament of physics. Other interesting approaches to 
the irreversibility problem have stressed the information-theoretical aspects of entropy the openness of systems 
and the influence of boundary conditions 'ill 7 the dynamic instability in chaos theory Il2l| . (For a good overview 
over the whole topic see [Tsj.^ 



B. The ansatz by Evans and Searles 

In the following I examine the solution to the irreversibility problem as suggested by Evans and Searles in and 
repeated in . Evans and Searles start with the response of a system to an external force, 

SB{ti)^L{ti-t2)F{t2)6t2. (1) 

F{t2) is the external force applied to the system at time t2. SB{ti) is the linear response at time ti of a system 
characterized by a response function L{ti — 12). This system is invariant to time translation. The total response at 
time t due to an external force at all previous times is 

Bc{t)= f Lc{t-h)F{h)dh. (2) 
J —00 

As a counterpart to Eq. (jSJ, which they call a causal response, Evans and Searles define an anticausal response 

/+00 
LA{t-h)F{h)dti. (3) 

Their argument can be summed up as follows: We live in a time-reversible world, hence all processes happen in 
both time-directions. So, there must be cases, where effect precedes cause. These cases are 'never' observed in the 
macroscopic world. However, on the microscopic level they have a certain probability. From these microscopic cases, 
Evans and Searles derive their concept of an anticausal world. 

This is problematic, since all processes in our reality, which is equipped with a determined direction of time, 
are causal by definition. Causality in this case is defined by the fact, that effects are preceded by causes. So, 
those supposedly 'anticausal' microscopic processes are by definition also causal, since they belong to the reality, 
we experience. Essentially, Evans and Searles implicitly define their anticausal world as a world where just the 
probabilities of all processes are reversed: 

Pc{A,h;B,t2) = PA{B,h;A,t4), (4) 

with fixed times ti to and t2 — ti = — t^. Pc{A,ti] B,t2) is the probability, that a system is in state A at 
time ti and in state B at time t2. All probabilities Pa relate to the postulated anticausal world, all probabilities Pc 
to reality. Ultimately, the anticausal world as defined by Evans and Searles would correspond to the universe seen 
under time-reversal. Since the real universe is governed by reversible laws, the anticausal universe is also governed 
by reversible laws. The difference between the causal and the anticausal universe is simply that initial conditions of 
processes in the real universe become final conditions of corresponding processes in the time-reversed universe and 
vice- versa. 

Through the definition of their anticausal world, Evans and Searles link the irreversibility of the world we experience 
to the difference between initial and final conditions. Again, I employ the word 'define', because the anticausal 
processes do not exist in reality. In the end, Evans and Searles arrive at the same conclusion as Boltzmann. As 
mentioned above, Boltzmann stated that there is no answer to why we live in such an improbable world. Evans and 
Searles also do not address this problem. 

Consider now a finite causal process and its corresponding anticausal equivalent : 

r+t 

Bc{t)= Lc{t-h)Fc{h)dti, (5) 



BA{~t)^- I LA{-t-h)FA{ti)dti. (6) 
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Eq. © describes just the time-reversed process Following from Eq. with ti = 0, ^2 = +t, = —t, and t4 = 0, 
we have for the time-reversed process, resulting from the exchange of initial and final states: 

Fc{s) ^ ±Fa{~s) =viFa{~s), VswithO<s<t. (7) 

The sign depends, if the generalized force Fc is symmetric or antisymmetric under time reversal. We also have 

Beit) = ±BA{-t) = V2BAi~t). (8) 

Again, the sign depends, if the quantity Be describing the response of the system is symmetric or antisymmetric in 
time. From Eqs. ^ and @ in combination with JHJ we can derive 

Lc{t-h)Fc{ti)dti^-V2 LA{~t~ti)FAiti)dh = -v2 LA{-t + h)FAi-h)dtu (9) 



-t 



which gives 



(Lcit - h) + V2ViLA{-t + ti))Fc{h)dti = 0. (10) 
Since this must hold for all processes, we have 

Lc{s) = ~V2ViLa{-s). (11) 
In their derivation in 0, Evans and Searles explicitly consider Green-Kubo relations for shear viscosity 

dJj_iky,t) _ ^ , ^^^ky,t-S)j^{ky,s)dS, t>0 (l2) 



dt p Jq 

and the anticausal equivalent 



dJ±{ky,t) _ fc, 
dt p Jt 



2 ^0 

y 



riA{ky,t — s)J±{ky, s)ds, t < 0. (13) 



i]C and rjA are the response functions (also called memory functions). J{ky, t) is the wave- vector dependent transverse 
momentum density. For interpretational details, that are not of importance in this context, compare il4j. It is 
clear, that for the specific example, we have 

Vl = ~V2, (14) 

because '^'^^^^ is the time-derivative of J±{ky, s). From this follows directly using Eq. Hll|l 

Vc{ky,t) ^ ■qA{ky,-t), (15) 

which is the result derived in Section III of . 

In their proof, Evans and Searles implicitly make the assumption when they identify anticausal autocorrelation 
functions with causal autocorrelation functions and thereby determine the probabilities of anticausal processes. Eq. 
()15|1 can be written out as 0: 

^{Py.{t)Pym)c = ^{Py.{^t)PyM)A, t > 0. (16) 

Note that contrary to Evans and Searles we distinguish between causal and anticausal autocorrelation functions. For 
the exact definition of Pyx^ that is again not important in this context, compare [^Il4|. Eq. (|16|l translates to 

j j dP'y,JPyxP'y^PyJc{P'yx.t-Pyx,Q)dt = j j dP^JPy , P^^ ^ Py J A{P'yx , Py . , O) dt . ( 1 7) 

To connect all processes and to fully define the anticausal world, this must hold for all autocorrelation functions, i.e. 

fc{P'yx,t-Py.,,0)^fA{P'y, ~t-Py.,,Q). (l8) 
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fc{Pyx:t; Pyx,0) is the probability distribution for the system being in state Py^ at time t and state Pyx at time 
0- fA{PyxT~'^iPvx,^) is the probabiUty distribution for anticausal processes. Eq. l(THll corresponds to Eq. It 
is essentiahy a relation between the initial states of an ensemble of causal processes and the final states of the 
corresponding ensemble of anticausal processes and vice versa. Evans and Searles implicitly make the assumption Q 
by not distinguishing between causal and anticausal autocorrelation functions. Thereby they determine the probability 
distributions for anticausal processes. 

To sum up, the argument in 0, 0] is that the origin of the observed irreversibility in the world has to do with 
causality. This program is carried out by comparing the real world with a proposed anticausal world. The main 
property of this anticausal world is the implicit assumption, that compared to the real causal world initial and final 
conditions are exchanged. Evans and Searles, however, do not address the question, why the initial conditions in 
the real world are such as observed. Thereby, Evans and Searles arrive simply at the standard conclusion concerning 
the irreversibility problem. This solution was already proposed by Boltzmann (cp. for example Q)- In 0] Evans 
and Searles just rename this interpretation, that irreversibility stems from the difference between initial and final 
conditions. Their expression is causality. 



C. The role of the Fluctuation Theorem 



The Fluctuation Theorem does not change the conclusion we have just drawn from Q^. The Fluctuation Theorem 
according to Evans and Searles 'gives an analytical expression for the probability of observing Second Law violating 
dynamical fluctuations in thermostatted dissipative non-equilibrium systems' It shall only be noted that these 
processes do not violate the Second Law in the probabilistic sense, in which it must be understood in the consequence 
of the work done by Boltzmann. But this is only a matter of names. More importantly the Fluctuation Theorem is 
fully compatible with Boltzmann's view that systems develop with greater probability into states closer to equilibrium 
(i.e. the most probable state) than in the opposite direction. Note, that this probabilistic interpretation of the Second 
Law as advocated by Boltzmann, Planck, Einstein and others makes no assumptions regarding if the systems are of 
finite or infinite size and if processes have finite or infinite duration. The systems are only assumed to be isolated. 

So, time-asymmetry always originates in the fact, that we start a process far from equilibrium, i.e. that we start 
from an improbable state. When 'deriving' the Second Law, it must always be assumed that the initial state is less 
probable than the final state. This is a necessary condition as long as one clings both to a probabilistic interpretation 
of entropy S* = fcs InfJ and reversible microscopic equations. Evans and Searles accept the two of them. 



III. THE CONCEPT OF CAUSALITY REQUIRED BY REVERSIBILITY 

The concept of causality employed by 0, ll| in the suggested solution to the irreversibility problem is one that 
is often used in physics and also philosophy, but which is not suitable for this specific context. It uses a definite 
time-order, where the time-coordinate of the cause is always smaller than (or maybe equal to) the time-coordinate 
of the effect and where cause and effect are not generally exchangeable. This concept of causality is used in linear 
response theory. There, an outside force determines through a response function the reaction of the system. The 
outside force is considered the cause, the reaction is the effect. Causality in this context means that the reaction of 
the system at time t may only be infiuenced by outside forces at times t' < t. 

We will now examine causality in Newtonian physics and find that there a totally different concept is employed, 
which does not allow for a distinction between cause and effect. The third Newtonian axiom 'actio=reactio' states 
the equivalence of the acting and the reacting force. In particular this means that one cannot distinguish in principle, 
which is the acting and which the reacting force, i.e. cause and effect cannot be distinguished in principle. Consider 
two massive particles A and B acting upon each other. The properties of particle A, e.g. its mass, are responsible for 
the motion of particle B and vice versa. It cannot be determined 'which acceleration of which particle comes first'. 
In case of Newtonian physics there is no distinction between cause and effect through time-order, as cause and effect 
are happening simultaneously (velocity of interaction is infinite). This can be seen very clearly in Newton's law of 
gravity 

F = g'^^. (19) 



The physical origin for the fact, that cause and effect are interchangeable, is the identity of passive and active mass for 
every particle. This corresponds to the third Newtonian axiom. Thus, in Newton's theory there is only mier-action. 
Cause and effect always have the same time-coordinate and are exchangeable. 
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Accepting the conceptual equality of cause and effect directly leads to the reversibility of all microscopic equations 
and vice versa. In fact, the Newtonian laws are only time-reversible since they rely on a concept of interaction and not 
time-ordered causation. This holds for the Hamiltonian formulation of mechanics as well as the equivalent Newtonian 
formulation. 

In Maxwellian electrodynamics, the situation might at first seem different, since in the framework of this theory 
signals can travel at most with the speed of light. Thus, at first sight there seems to be a fixed time-order of causes 
and effects. Still, Maxwell Equations are known to be invariant under time reversal and simultaneous reversal of the 
magnetic field. It is the existence of both advanced and retarded solutions that makes Maxwellian electrodynamics 
invariant under time reversal. When advanced solutions are dismissed on the basis of 'causality', as is done in many 
books on electrodynamics, already the reversibility of the theory is given up. So, the reversibility of Maxwellian 
electrodynamics depends on the acceptance of advanced solutions, in other words solutions where in a conventional 
dictation cause and effect would be exchanged. Only under this premise is the theory time-reversible because only 
then it is not possible to distinguish between cause and effect because every process can happen in both directions: 
For every process with cause A and effect B one must accept the possibility of a process with cause B and effect A. 
In addition we do not make any assumptions about the probabilities of those processes (which in fact is not possible 
in the framework of Maxwellian electrodynamics). 

If we speak of time-ordered causality, we do not consider reversible causality as in electrodynamics but imply that 
cause and effect are not conceptually equivalent. In a strong version of time-ordered causality at least for some 
processes with cause A and effect B there does not exist a corresponding process with cause B and effect A. In a 
weaker version of time-ordered causality, for every process with cause A and effect B there exists a corresponding 
process with cause B and effect A, but the probabilities of both processes differ. The weaker version is essentially 
the solution to the irreversibility problem as given by Boltzmann. This solution is possible because the microscopic 
equations do not make any statements about the probabilities of processes. They only state, if processes are allowed 
in principle or not. 

It is tautological to say that time-ordered causality can solve the problem of irreversibility. The microscopic 
equations do not exhibit time-ordered causality. Once we admit a clear distinction between events of cause and events 
of effect, then of course physics is not reversible by definition. In Q the strong version of time-ordered causality is 
suggested by the cited example of throwing on a switch and 'afterwards' observing the light go on. Then, like in 
Boltzmann's work the weak version is employed to solve the irreversibility problem. 

As for the argument in _3J , we have found that reversibility requires a concept of causality, where a distinction 
between causes and effects cannot be established - neither on deterministic nor on probabilistic grounds (corresponding 
to the strong or weak version of time-ordered causality). Full reversibility and a concept of causality, where causes 
and effects are interchangeable, are two sides of the same coin. Both statements are equivalent. When Evans and 
Searles give the example of switching on a light, they presumed a concept of causality, that is not compatible with 
reversibility. However, Evans and Searles have not shown how their concept of causality derives from the concept of 
causality necessary for reversible microscopic equations - other than by making assumptions about initial conditions 
just as Boltzmann did more than a hundred years ago. All questions that go beyond Boltzmann's solution - e.g. the 
ones of Section III Al - remain unanswered. 



[1] D. J. Evans and E. G. D. Cohen and G. P. Morriss, Phys. Rev. Lett. 71, 2401 (1993) 

[2] D. J. Evans and D. J. Searles, Phys. Rev. E 53, 5808 (1996) 

[3] D. J. Evans and D. J. Searles, Adv. Phys. 51, 1529 (2002) 

[4] C. Jarzynski, Phys. Rev. Lett. 78, 2690 (1996) 

[5] C. Jarzynski, Phys. Rev. E 56, 5018 (1997) 

[6] C. Jarzynski, J. Stat. Phys. 98, 77 (2000) 

[7] G. E. Crooks, Phys. Rev. E 60, 2721 (1999) 

[8] L. Boltzmann, Wied. Ann. 57, 773 (1896) 

[9] A. Einstein and W. Ritz, Phys. Z. 10, 323 (1909) 
[10] E. T. Jaynes, Phys. Rev. 106, 620; 108, 171 (1957) 
[11] W. G. Hoover, J. Chem. Phys. 109, 4164 (1998) 
[12] I. Prigogine, From Being to Becoming (Freeman, 1980) 

[13] H. D. Zeh, The Physical Basis of the Direction of Time (Springer, Berlin, 1992) 

[14] D. J. Evans and G. P. Morriss, Statistical Mechanics of Nonequilibrium Liquids (Academic, London, 1990) 



